A Comparative Evaluation of Annotation Software for Grading Programming Assignments

Commenting on a student’s computer program with red pen ink annotations is not possible with current software and paper program ‘listings’ are a relic of a bygone era. Yet ink annotations are the easiest way to provide rich feedback to the student. We have developed and evaluated Penmarked as a software solution to this problem. It supports free-form ink annotations and, importantly, associated marking tasks of gathering and returning assignments and recording grades. The evaluation against paper and digital marking systems showed it to be faster and more effective. From a wider perspective Penmarked demonstrates the intricacies of providing totally paperless environment.